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(54) Apparatus for parallel decoding of digital video signals 

(57) A novel apparatus for decoding an encoded dig- 
ital video signal is able to carry out a parallel processing, 
without using a shared memory system. This apparatus 
comprises detector for detecting slice start codes from 
the encoded digital video signal and generating a slice 
start detection signal, control unit for counting the 
number of the slice start codes of the encoded bit stream, 
and for generating a control signal in response to the 
counted number of the slice start codes, switching block 
for dividing video frame data into two subframes, two 
f irst-infirst-out(FIFO) buffers for storing the divided video 
frame data, a image processing device for decompress- 
ing the encoded digital video signal and reproducing the 
original video image signal, and frame formatter for cou- 
pling the reproduced original video image signal. 



FIG.3 



1° 



IMAGE DATA PARTITIONING CIRCUrr| 




Primed by Rank Xerox (UK) Business Services 
2.12.4/3.4 



1 



EP 0 720 374 A1 



2 



Description 

Field of the Invention 

The present invention relates to a video imaging sys- 
tem; and, more particularly, to an improved video image 
decoding apparatus having two decoding modules for 
decompressing incoming compressed video image data 
in parallel. 

Description of the Prior Art 

In various electronic/electrical applications such as 
high definition television and video telephone systems, 
an image signal may need be transmitted in a digitized 
form. When the image signal is expressed in a digitized 
form, there is bound to occur a substantial amount of dig- 
ital data. Since, however, the available frequency band- 
width of a conventional transmission channel is limited, 
in order to transmit the image signal therethrough, the 
use of an image signal encoding apparatus becomes 
necessary to compress the substantial amounts of digital 
data. 

Accordingly, most image signal encoding apparatus 
employ various compression techniques (or coding 
methods) built on the idea of utilizing or reducing spatial 
and/or temporal redundancies inherent in the input 
image signal. 

Among the various video compression techniques, 
the so-called hybrid coding technique, which combines 
temporal and spatial compression techniques together 
with a statistical coding technique, is known to be most 
effective. 

Most hybrid coding techniques employ a motion 
compensated DPCM(differential pulse code modula- 
tion), two-dimensional DCT(discrete cosine transform), 
quantization of DCT coefficients, and VLC(variable 
length coding). The motion compensated DPCM is a 
process of determining the movement of an object 
between a current frame and its previous frame, and pre- 
dicting the current frame according to the motion flow of 
the object to produce a differential signal representing 
the difference between the current frame and its predic- 
tion. This method is described, for example, in Staffan 
Ericsson, "Fixed and Adaptive Predictors for Hybrid Pre- 
dictive/Transform Coding", IEEE Transactions on Com- 
munications. COM-33. No. 12(December 1985); and in 
Ninomiya and Ohtsuka, "A Motion Compensated Inter- 
frame Coding Scheme for Television Pictures", IEEE 
Transactions on Communications. COM-30. No. 1 (Jan- 
uary 1982). 

The two-dimensional DCT, which reduces or 
removes spatial redundancies between image data such 
as motion compensated DPCM data, converts a block of 
digital image data, for example, a block of 8x8 pixels, into 
a set of transform coefficient data. This technique is 
described in Chen and . Pratt, "Scene Adaptive Coder", 
IEEE Transactions pp Communications COM-32. No. 
3(March 1 984). By processing such transform coefficient 



data with a quantizer, zigzag scanner and VLC circuit, 
the amount of data to be transmitted can be effectively 
compressed. 

Specifically, in the motion compensated DPCM, cur- 

5 rent frame data is predicted from previous frame data 
based on an estimation of the motion between the cur- 
rent and the previous frames.- Such estimated motion 
may be described in terms of two dimensional motion 
vectors representing the displacement of pixels between 

w the previous and the current frames. 

In order to compress the image signals with the 
above mentioned technique, the use of a processor 
capable of carrying out a high speed processing 
becomes necessary, and this is usually achieved by 

is employing a parallel processing technique. Generally, in 
the image signal decoding apparatus having the parallel 
processing capability, one video image frame area is 
divided into a plurality of subframes, and image data 
within the video image frame area is processed on a sub- 

20 frame-by-subframe basis. 

Oh the other hand, to determine a motion vector for 
a search block in the current frame, a similarity calcula- 
tion is performed between the search block of the current 
frame and each of a plurality of equal-sized candidate 

25 blocks included in a generally larger search region within 
a previous frame, wherein the size of the search block 
typically ranges between 8x8 and 32x32 pixels. Conse- 
quently, the search region containing a boundary portion 
of any subframe also includes a boundary portion of a 

30 neighboring subframe. Accordingly, the motion estima- 
tion carried out by each processor requires a shared 
memory system with a multiple random access capabil- 
ity. 

35 Summary pf the Invention 

It is, therefore, a primary object of the present inven- 
tion to provide an improved video image decoding appa- 
ratus capable of carrying out a parallel processing, 

40 without having to use a shared memory system with a 
multiple random access capability. 

In accordance with the present invention, there is 
provided an apparatus for decoding an encoded digital 
video signal in an encoded bit stream for the reproduc- 

45 tion of an original video image signal, wherein the 
encoded digital video signal includes a plurality of video 
frame data, each video frame data having a number of 
slice start codes representing a start of each slice 
therein, said apparatus comprising: means for detecting 

so the slice start codes from the encoded digital video signal 
and generating a slice start detection signal; control 
means for counting the number of the slice start codes 
of the encoded bit stream in response to the slice start 
detection signal, and for generating a control signal in 

55 response to the counted number of the slice start codes; 
means, responsive to the control signal, for dividing 
video frame data into two subframes; two first-in first- 
out(FIFO) buffers for storing the divided video frame 
data; image processing means for decompressing the 
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encoded input data and reproducing the original video 
image signal; and means for coupling the reproduced 
original video image signal. The image processing 
means includes two decoder modules and a frame mem- 
ory part for reproducing the original video image signal, 
wherein each decoder module reproduces each of the 
two subframes, and the memory part includes two mem- 
ory modules for storing the divided video frame data, a 
memory module selection controller for generating first 
and second selection signals, and first and second 
address data, and selecting means for producing pixel 
data stored in the corresponding memory modules in 
response to the first and second selection signals. 

Brief Description of the Drawings 

The above and other objects and features of the 
present invention will become apparent from the follow- 
ing description of preferred embodiments given in con- 
junction with the accompanying drawings, in which: 

Fig. 1 is a schematic representation of a video image 
frame area divided into two subframes; 
Fig. 2 represents a block diagram of the inventive 
decoding apparatus comprising an image data par- 
titioning circuit and an image processing device; 
Fig. 3 presents a more detailed block diagram of the 
image processing device coupled to the image data 
partitioning circuit shown in Fig. 2; and 
Fig. 4A and 4B describe a timing diagram represent- 
ing the order of processing for each subframe. 

Detailed Description of the Preferred Embodiments 

The present invention provides for the communica- 
tion of high definition television(HDTV) signals from a 
transmitter location to a population of receivers. At the 
transmitter of an encoder" end of the communication link, 
digital video signals for successive frames of a television 
picture are broken down into subframes for processing 
by multiple processors. The inventive decoding appara- 
tus includes two decoder modules, each of which is ded- 
icated to the decoding of video data from a particular 
subframe. 

Referring to Fig. 1, there is shown a video image 
frame area 10 divided into two subframes. The total 
frame area encompasses M horizontal picture lines, 
each picture line containing N pixels. For example, a sin- 
gle HDTV frame comprises 960 picture lines, each pic- 
ture line including 1408 pixels. In other words, a single 
HDTV frame comprises 60 slices, each slice including 
16 horizontal picture lines. 

In accordance with the present invention, a video 
image frame area is divided into two subframes, e.g., 
subframes 13, 16 as illustrated in Fig. 1. 

In order to process the two subframes, a processor 
is assigned to each subframe for decompressing com- 
pressed digital data bounded by the subframe in a video 
frame. In an encoding apparatus, data redundancies 



between a current video frame and one or more of its 
prior video frames is reduced using a motion estima- 
tion/compensation technique. 

Referring to Fig. 2, there is illustrated a block dia- 

s gram of the inventive parallel image decoding apparatus, 
which comprises an image data partitioning circuit 30 
and an image processing device 40. 

The image data partitioning circuit 30 which includes 
a slice start code(SSC) detector 31 . a control unit 32, a 

10 switching block 33, and two f irst-in f irst-out(FlFO) buffers 
34, 35 is coupled to the image processing device 40; and 
serves to divide the encoded digital data into two sub- 
frames for the processing thereof on a subframe-by-sub- 
frame basis. The image processing device 40 includes 

15 two decoder modules 50, 60. each of the decoder mod- 
ules having variable length decoding(VLD) circuits 51, 
61, motion compensators 52, 62, inverse zigzag scan- 
ners 53. 63, inverse quantizers(IQs) 54, 64, inverse dis- 
crete cosine transform(IDCT) circuits 55, 65 and adders 

20 56, 66 decompresses compressed input digital data in 
connection with a frame memory part 70, respectively. 

As shown in Fig. 2, a variable length encoded digital 
video signal received from an encoding apparatus(not 
shown) is inputted via terminal 20 to the SSCs detector 

2$ 31. The encoded digital video signal includes a plurality 
of video frame data, each of said video frame data occu- 
pying a video image frame area has variable length 
coded transform coefficients, motion vectors and a 
number of SSCs. wherein each SSC represents a start 

30 of a slice included in the encoded bit stream. The SSC 
detector 31 detects slice start codes from the encoded 
digital video signal and generates a slice start detection 
signal to the control unit 32 which serves to control the 
switching block 33. The control unit 32 counts the 

35 number of SSCs in response to the slice start detection 
signal provided from the SSC detector 31 . Whenever the 
counted number of the SSCs reaches a predetermined 
value, eg., 30. a control signal for alternately switching 
the encoded digital video signal supplied from the SSC 

40 detector 31 between S1 and S2 is generated by the con- 
trol unit 32, thereby dividing each frame of the incoming 
encoded image signal into two subframes and storing 
them in two FIFO buffers 34, 35. The FIFO buffers output 
the subframe data to corresponding decoder modules 

45 50, 60, incorporated in the image processing device 40, 
each of said decoder modules is dedicated to the 
processing of video image data bounded by a particular 
subframe and substantially identical each other. The 
image processing device 40 reconstructs a discrete 

50 cosine transform(DCT) coefficients, performs a motion 
compensation based on a motion vector, and constitutes 
representative image data of a given block in the current 
frame. The decoded subframe data from the image 
processing device 40 is sent to a frame formatter 80 and 

55 combined therein to form a single data stream represent- 
ing the original video image signal to be, e.g., displayed 
on a display unit(not shown). 

Referring now to Fig. 3, there is shown a more 
detailed block diagram of the image processing device 
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40 coupled to the image data partitioning circuit 30 
shown in Fig. 2. The decoder modules 50 and 60 con- 
tained in the image processing device 40 are made of 
identical elements, each element serving a same func- 
tion. 

As shown in Fig. 3. video image data bounded by a 
particular subframe is provided from the image data par- 
titioning circuit 30 to variable length decoding(VLD) cir- 
cuits 51, 61 through lines 501, 601, respectively. Each 
VLD circuit processes the video image data bounded by 
a corresponding subframe. That is, each VLD circuit 
decodes the variable length coded transform coefficients 
and the motion vectors to send the transform coefficient 
data to respective inverse zigzag scanners 53, 63 and 
the motion vector data to each of the motion compensa- 
tors 52, 62, incorporated in the decoder modules. The 
VLD circuits are basically a look-up table: that is, in the 
VLD circuits, a plurality of code sets is provided to define 
respective relationships between variable length codes 
and their run-length codes or motion vectors. The output 
from each VLD circuit is then distributed to a correspond- 
ing processor. Each processor processes video image 
data bounded by a corresponding subframe. 

Video image data bounded by the first subframe 1 3 
shown in Fig. 1 is provided from the VLD circuit 51 to the 
inverse zigzag scanner 53 through a line 503. In the 
inverse zigzag scanner 53, the quantized DCT coeffi- 
cients are reconstructed to provide an original block of 
quantized DCT coefficients. A block of quantized DCT 
coefficients is converted into DCT coefficients in the 
inverse quantizer(IQ) 54 and fed to the inverse discrete 
cosine transform(IDCT) circuit 55 which transforms the 
DCT coefficients into difference data between a block of 
the current subframe and its corresponding block of the 
previous subframe. The difference data from the IDCT 
circuit 55 is then sent to the adder 56. 

In the meanwhile, the variable length decoded 
motion vector from the VLD circuit 51 is fed to the motion 
compensator 52 and a memory module selection con- 
troller 75 within the frame memory part 70 via lines 502 
and 701. The motion compensator 52 extracts corre- 
sponding pixel data from the previous subframe stored 
in the frame memory part 70 based on the motion vector 
and sends the corresponding pixel data to the adder 56. 
The corresponding pixel data derived from the motion 
compensator 52 and the pixel difference data from the 
IDCT circuit 55 are summed up at the adder 56 to con- 
stitute representative image data of a given block of the 
current subframe and written onto the first memory mod- 
ule 71 and transmitted to the frame formatter 80 as 
shown in Fig. 2. 

Also, the decoder module 60 is similar to the 
decoder module 50 in structure and operation. In other 
words, video image data bounded by the second sub- 
frame 16 shown in Fig. 1 is provided from the VLD circuit 
61 to the inverse zigzag scanner 63 via a line 603, and 
the quantized DCT coefficients are reconstructed 
therein. The quantized DCT coefficients are converted 
into DCT coefficients in the IQ 64 and fed to the IDCT 



circuit 65. thereby transforming the DCT coefficients into 
difference data between a block of the current subframe 
and its corresponding block of the previous subframe. 
The difference data from the IDCT circuit 65 is then sent 

5 to the adder 66. 

In the meanwhile, the motion vector from the VLD 
circuit 61 is fed to the motion compensator 62 and the 
memory module selection controller 75 via lines 602 and 
702. The motion compensator 62 extracts corresponding 

10 pixel data from the previous subframe stored in the frame 
memory part 70 based on the motion vector and provides 
the corresponding pixel data to the adder 66. The corre- 
sponding pixel data derived from the motion compensa- 
tor 62 and the pixel difference data from the IDCT circuit 

is 65 are summed up at the adder 66 to constitute repre- 
sentative image data of a given block in the current sub- 
frame and written onto the second memory module 72 
and transmitted to the frame formatter 80 as shown in 
Fig. 2. 

20 In accordance with the present invention, one video 
image frame area is divided into two subf rames, each of 
the subframe data being processed through the use of 
a corresponding decoder module. In this case, when the 
boundary portion between the two subframes, e.g., slice 

25 30 or slice 31 shown in Fig. 1 , is processed, the motion 
compensator 52 or 62 may access one of the memory 
modules 71 , 72. That is, if the first motion vector provided 
from the VLD circuit 51 is found in the subframe 1 6 during 
the processing of the slice 30 within the subframe 1 3, the 

30 motion compensator 52 should access the memory 
module 72. Similarly, if the second motion vector applied 
from the VLD circuit 61 is in the subframe 13 during the 
processing of the slice 31, the motion compensator 62 
should access the memory module 71. At this time, the 

35 motion compensation process performed by each of the 
two decoder modules is controlled to prevent the two 
motion compensators from concurrently attempting to 
access a same memory module. In other words, the two 
memory modules are made to have an appropriate dead- 

40 lock so that the two motion compensators do not access 
a same memory module, simultaneously. A more 
detailed description of the above mentioned operation 
will be provided with reference to Fig. 4. 

As shown in Fig. 3, for this mutually exclusive mem- 

45 ory module access, the frame memory part 70 includes 
two memory modules 71 , 72, the two multiplexer circuits 
73, 74 and the memory module selection controller 75. 
At the memory module selection controller 75. it is 
checked whether the motion vectors are in an adjacent 

so subframe. 

The memory module selection controller 75 receives 
first and second motion vectors from the VLD circuits 51 , 
61 via lines 701, 702 and generates first and second 
selection signals through lines 703, 704 to the multi- 

55 plexer circuits 73. 74. Also, the memory module selection 
controller 75 simultaneously produces first and second 
address data via lines 705, 706 to the memory modules 
71,72. 
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When each of the motion vectors provided from the 
VLD circuits to the memory module selection controller 
75 is in each of the corresponding subf rames, the mem- 
ory module selection controller 75 generates the first and 
second selection signals, e.g., logic "low", to multiplexer 5 
circuits 73, 74. Each multiplexer circuit outputs corre- 
sponding pixel data from the previous subframe stored 
in the corresponding memory module based on the 
motion vectors, in response to the first and second selec- 
tion signals with a said logic low". That is, when the first w 
selection signal is a logic low", the multiplexer circuit 73 
furnishes the pixel data supplied from the memory mod- 
ule 71 to the motion compensator 52. Similarly, when the 
second selector signal is a logic "low", the multiplexer 
circuit 74 offers the pixel data supplied from the memory 75 
module 72 to the motion compensator 62. 

When each of the motion vectors is in another adja- 
cent subframe, the first and second selection signals pro- 
duced by the memory module selection controller 75 are 
logic "high". In this case, the multiplexer circuits 73 and 20 
74 output the pixel data from the memory modules 72 
and 71 , respectively. As noted above, the mutually exclu- 
sive memory accessing operation between the two 
memory modules 71 , 72 is performed under the control 
of the memory module selection controller 75. 25 

Referring now to Figs. 4A and 4B, there is shown a 
timing diagram representing the order of processing for 
each subframe. 

As indicated in Fig. 4, the decoder module 50 starts 
the processing of the video image data occupying the 30 
subframe 13. After processing all of the slices contained 
in the subframe 13, the processing of the subframe 16 
is commenced by the decoder module 60. At this time, 
the decoder module 50 has a deadlock until the decoder 
module 60 completes the processing of the slice 31 in 35 
the subframe 1 6 in order to prevent the two motion com- 
pensators 52, 62 shown in Fig. 3 from accessing a same 
memory module. When the slice 31 is processed by the 
decoder module 60, the decoder module 50 begins the 
processing of next subframe data, e.g., slice V, in a next 40 
video image frame area. The decoder module 60 has a 
deadlock until the decoder module 50 completes the 
processing of the slice 30' in said next video image frame 
area. In this manner, each of the decoder modules 50, 
60 repeats the decoding operation until all of the incom- 45 
ing video image data is processed. 

While the present invention has been described with 
respect to certain preferred embodiments only, other 
modifications and variations may be made without 
departing from the spirit and scope of the present inven- so 
tion as set forth in the following claims. 

Claims 

1. An apparatus for decoding an encoded digital video 55 
signal in an encoded bit stream for the reproduction 
of an original video image signal, wherein the 
encoded digital video signal includes a plurality of 
video frame data, each video frame data having a 



number of slice start codes representing a start of 
each slice therein, which comprises: 

means for detecting the slice start codes from 
the encoded digital video signal and generating a 
slice start detection.signal; 

control means for counting the number of the 
slice start codes in the encoded bit stream in 
response to the slice start detection signal, and for 
generating a control signal in response to the 
counted number of the slice start codes; 

means, responsive to the control signal, for 
dividing video frame data into two subframes; 

two first-in firstout(FIFO) buffers for storing 
the divided video frame data; 

image processing means for decompressing 
the encoded digital video signal and reproducing the 
original video image signal; and 

means for coupling the reproduced original 
video image signal. 

2. The apparatus of daim 1, wherein the image 
processing means includes two decoder modules 
and a frame memory part for reproducing the origi- 
nal video image signal, wherein each of the decoder 
modules generates the decompressed digital video 
signal, and the frame memory part includes two 
memory modules for storing the decompressed dig- 
ital video signal, a memory module selection con- 
troller for generating first and second selection 
signals and first and second address data, and 
selecting means for producing pixel data stored in 
the corresponding memory modules in response to 
the first and second selection signals. 
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